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(57) Abstract 

A universal programmable remote control device has programmability functions that enable the end-user to customize the device 
through editing or programming the device's control functionalities. The programming can be achieved via a PC. The control configuration 
created via an editor on the PC can be downloaded into the device. The PC has emulator software to test the configuration before 
downloading. The emulator software and the remote's control software are made identical as a consequence of a software layer that abstracts 
from the remote's hardware. The emulator for the end-user is thus obtained as an almost free byproduct of the software development phase 
at the manufacturer. 


FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 


AL 

Albania 

ES 

Spain 

LS 

Lesotho 

SI 

Slovenia 

AM 

Armenia 

FT 

Finland 

LT 

Lithuania 

SK 

Slovakia 

AT 

Austria 

PR 

France 

LU 

Luxembourg 

SN 

Senegal 

AU 

Australia 

GA 

Gabon 

LV 

Latvia 

sz 

Swaziland 

AZ 

Azerbaijan 

GB 

United Kingdom 

MC 

Monaco 

TD 

Chad 

BA 

Bosnia and Herzegovina 

GE 

Georgia 

MD 

Republic of Moldova 

TG 

Togo 

BB 

Barbados 

GH 

Ghana 

MG 

Madagascar 

TJ 

Tajikistan 

BE 

Belgium 

GN 

Guinea 

MK 

The former Yugoslav 

TM 

Turkmenistan 

BF 

Burkina Paso 

GR 

Greece 


Republic of Macedonia 

TR 

Turkey 

BG 

Bulgaria 

HU 

Hungary 

ML 

Mali 

TT 

Trinidad and Tobago 

BJ 

Benin 

IE 

Ireland 

MN 

Mongolia 

UA 

Ukraine 

BR 

Brazil 

1L 

Israel 

MR 

Mauritania 

UG 

Uganda 

BV 

Belarus 

IS 

Iceland 

MW 

Malawi 

US 

United States of America 

CA 

Canada 

IT 

Italy 

MX 

Mexico 

uz 

Uzbekistan 

CF 

Central African Republic 

JP 

Japan 

NE 

Niger 

VN 

Viet Nam 

CG 

Congo 

KE 

Kenya 

NL 

Netherlands 

YU 

Yugoslavia 

CH 

Switzerland 

KG 

Kyrgyzstan 

NO 

Norway 

ZW 

Zimbabwe 

CI 

Cote (Tlvoire 

KP 

Democratic People' i 

NZ 

New Zealand 



CM 

Cameroon 


Republic of Korea 

PL 

Poland 



CN 

China 

KR 

Republic of Korea 

PT 

Portugal 



cu 

Cuba 

KZ 

Kazak&tan 

RO 

Romania 



cz 

Czech Republic 

IX 

Saint Lucia 

RU 

Russian Federation 



DE 

Germany 

u 

Liechtenstein 

SD 

Sudan 



DK 

Denmark 

LK 

Sri Lanka 

SB 

Sweden 



EE 

Estonia 

LR 

Liberia 

SG 

Singapore 




WO 00/39772 


Fully functional remote control editor and emulator. 


PCT/EP99/10230 


The invention relates to a system and method for programming or testing a 
programmable remote control device. 

Ever increasingly more sophisticated electronic audio/video (AV) equipment 
and home automation equipment are being introduced on the consumer electronics (CE) 
5 market. Typically, the equipment is programmable by the end-user in order to tailor the 

numerous functionalities and settings to the individual preferences. The user-interactivity and 
synergy aspects of the equipment are determined substantially by software such as interactive 
applications, control software and GUI's. See, for example, to the HAVi architecture and the 
Home API initiative, both involving substantial contributions from Philips Electronics, the Jini 
10 technology of Sun Microsystems, Inc., etc. For more information on these technologies, see 
below. 

A step forward in user-friendliness regarding interacting with the equipment is 
the universal programmable remote controller, such as the "RC-2000* 1 of Marantz and the 
"Pronto" made by Philips Electronics. The term "universal remote" refers to a device that 

15 enables the end-user to control the majority of his/her collection of remotely controllable 
apparatus, regardless of the type or brand of the individual apparatus. This universal 
controllability is achieved by accommodating on the remote a data base of multiple sets of 
existing control (IR or RF) codes, each particular set being associated with a particular type of 
apparatus of a particular brand. In addition, the universal remote is programmable to leam or 

20 adopt new codes and to associate them with a particular user-defined input. The "Pronto", for 
example, has built-in RC-5 and RC-6 codes for Philips and Marantz equipment, IR-sending 
and IR-learning eyes, and an RS232 serial port connector for after-market expandability, e.g., 
via a PC. The "Pronto" provides a GUI via an LCD touch screen and also has direct-access 
buttons for frequently used control functions. Built-in are customizable device templates for 

25 full control; the options to assign control functions to icons or buttons; options to delete and 
create icons or buttons; to program and edit macros; a keyboard with soft keys for (re-) 
labeling buttons, icons and templates or the GUI's control panels. In short, the "Pronto" is 
highly customizable in terms of the GUI's lay-out, appearance, labeling, organization and in 
terms of programming and editing the control functions. 
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As to HAVi, see, e.g., the following co-pending applications incorporated 
herein by reference: 

U.S. Serial No. 08/73 1,624 (Attorney docket PHA 23,169) filed 10/15/96 for 
Paul Chambers et al., for TASK-DRIVEN DISTRIBUTED MULTIMEDIA CONSUMER 

5 SYSTEM. This patent document relates to a control system with multiple consumer 

electronics devices and task-driven control means coupled to the devices for controlling an 
interaction among the devices. The control means acts on respective software representations 
of each respective one of the consumer devices. By encapsulating the variable complexity of 
the task within a software representation, it can be made as simple or as sophisticated as 

10 needed to bring the capabilities up to a common level. Since the level of interface is common 
to the devices, applications can uniformly manipulate devices which embody very different 
levels of sophistication. 

U.S. Serial No. 09/107,525 (Attorney docket PHA 23,438) filed 6/30/98 for 
Gregory Gewickey and Yevgeniy Shteyn for DYNAMIC DE-REGISTERING OF DEVICES 

1 5 IN SYSTEM WITH MULTIPLE COMMUNICATION PROTOCOLS. This patent document 
relates to an information processing system has first and second electronic sub-systems, and 
control means for controlling the sub-systems. At least the first sub-system has a software 
representation registered with the control means. The control means changes a state of the first 
sub-system through interacting with the software representation. The first and second sub- 

20 systems are also capable of interacting directly with one another without the control means 
being involved. To avoid conflicts, at least the first sub-system is capable of de-registering 
with the control means so as to functionally disable its software representation at the control 
means. 

U.S. Serial No. 09/146,020 (Attorney docket PHA 23,492) filed 9/2/98 for 
25 Yevgeniy Shteyn for LOW DATA-RATE NETWORK REPRESENTED ON HIGH 
DATA-RATE HAVi-NETWORK. This patent document relates to a PC-based home 
automation system that uses a low data-rate transport layer and COM-based software 
components for control of devices in a home automation network. The home automation 
system is merged with a messaging-based HAVi-network that uses IEEE 1394 as a high data- 
30 rate transport layer. The HAVi-network controls audio/video equipment in a home 

entertainment system. The home automation services and devices are registered as a HAVi- 
compliant elements with the HAVi network's FAV or IAV device. The home automation 
resources (devices and services) have both COM OLE Automation Interfaces and HAVI- 


WO 00/39772 ^ PCT/EP99/10230 

compliant interfaces to permit control of the home automation system from the HAVi- 
network. 

As to Home API, see, e.g., the following co-pending applications incorporated 
herein by reference: 

5 US. Serial No. 09/146,020 (Attorney docket PHA 23,492) filed 9/2/98 for 

Yevgeniy Shteyn for LOW DATA-RATE NETWORK REPRESENTED ON HIGH 
DATA-RATE HAVi-NETWORK mentioned above. 

U.S. Serial No. 09/165,683 (Attorney docket PHA 23,483) filed 10/2/98 for 
Yevgeniy Shteyn for CALLS IDENTIFY SCENARIO FOR CONTROL OF SOFTWARE 

10 OBJECTS VIA PROPERTY ROUTES. This patent document relates to an information 

processing system with first and second physical components represented by a first and second 
software objects. Both objects have properties that are changeable through calls to the objects. 
The system enables registering a property route linking a first property of the first object to a 
second property of the second object so that a change in the first property causes the second 

15 call being issued to the second object upon invoking the property route. The input call to the 
first object comprises an identifier enabling to conditionally invoke the route. In this manner, 
routes belonging to different scenarios are being kept independent so that the system operates 
more reliable that without scenario identifiers. 

U.S. Serial No. 09/165,682 (Attorney docket PHA 23,484) filed 10/2/98 for 

20 Yevgeniy Shteyn for CONTROL PROPERTY IS MAPPED ONTO MODALLY 

COMPATIBLE GUI ELEMENT. This patent document relates to an information processing 
system that has an electronic device and a controller for control of a functionality of the 
device. An abstract representation of the functionality is provided to the controller. The 
abstract representation exposes a modality of controlling the functionality. The controller 

25 enables controlling the functionality through interaction with the abstract representation. The 
modality controls associating the control of the functionality with a modally compatible 
controlling capability of the controller. The modality exposed can be, for example, "Boolean", 
l4 float'\ "integer array 1 '. 

U.S. Serial No. 09/213.527 (Attorney docket PHA 23,529) Filed 12/17/98 for 

30 Yevgeniy Shteyn for SYNCHRONIZING PROPERTY CHANGES TO ENABLE 
MULTIPLE CONTROL OPTIONS. This patent document relates to an information 
processing system whose components are represented by software objects, the properties of 
which can be changed through function calls. Setting a property of an object controls the 
associated component Properties are connected through routes that propagate state changes 
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throughout the system without the need for a running client application. Two-way property 
routes are used to keep consistence among a controlled object and multiple controlling objects 
without the risk of endless loops. To achieve this, the two-way route is executed to change a 
state of a specific one of the properties upon a change of state of another one of the properties 
5 if the change of state of the other property was caused by an effect other than the route itself. 

As to PC networking, see, e.g., U.S. Serial No. 09/133,622 (Attorney docket 
PHA 23,488) filed 8/13/98 for Lawrence Freeman for HOME-NETWORK 
AUTOCONFIGURATION and incorporated herein by reference. This patent document relates 
to the automatic configuration of PC's in a (home) network in order to share resources 

10 registered at the individual PCs. Services and resources local to one PC are registered with 
the other PC and vice versa. The registry hides whether a service or resource is remote or 
local. In operational use of the network, a resource or service local to one PC is addressable 
from the remote PC as if it were local to the latter. A home network of PC's is configured 
automatically in this manner. 

15 As to some aspects of the "Pronto", see, e.g., the following co-pending 

applications, herein incorporated by reference: 

U.S. Serial No. 09/062,364 (Attorney docket PHA 23,387) filed 4/17/98 for Jan 
van Ee and Sung Choi for GRAPHICAL USER INTERFACE TOUCH SCREEN WITH 
AUTO ZOOM FEATURE. This patent document relates to a GUI with a touch screen having 

20 an entire collection of icons displayed at a scale in which the individual function of each icon 
is recognizable, but to small to easily access features of the function, and wherein upon 
touching the screen area accommodating an area of the icon, the screen provides a zoomed-in 
version of that area so that the user can select a desired feature. 

U.S. Serial No. 09/128,839 (Attorney docket PHA 23,469) filed 8/4/98 for Jan 

25 van Ee for REMOTE CONTROL HAS ANIMATED GUI. This patent document relates to A 
remote control device for remote control of home theater equipment has a display with a touch 
screen representing a GUI. User-activation of the GUI causes its appearance to change. The 
change is effected through animation. Animation is the simulation of movement created by 
displaying a series of bitmaps. The animation lets the user perceive the change as a smooth 

30 transition. Thus the impression is avoided of an abrupt confrontation with a new lay-out. 

U.S. Serial No.09/129,300 (Attorney docket PHA 23,470) filed 8/5/98 for Jan 
van Ee for GUI OF REMOTE CONTROL FACILITATES USER-FRIENDLY EDITING OF 
MACROS. This patent document relates to a remote control device for a home theater. The 
device has a macro creation/editing mode with authoring tools on the remote's GUI. One of 
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the editing tools lets the user move a selected macro step visibly up or down the list of steps on 
the GUI. 

As to customer support via the Internet, see the following co-pending 
applications incorporated herein by reference: 
5 U.S. Serial No.09/160,490 (Attorney docket PHA 23,500) filed 9/25/98 for 

Adrian Turner et al., for CUSTOMIZED UPGRADING OF INTERNET-ENABLED 
DEVICES BASED ON USER-PROFILE. This patent document relates to a server system that 
maintains a user profile of a particular end-user of consumer electronics network-enabled 
equipment and a data base of new technical features for this type of equipment. If there is a 

10 match between the user-profile and a new technical feature, and the user indicates to receive 
information about updates or sales offers, the user gets notified via the- network of the option 
to obtain the feature. 

U.S. Serial No.09/189,535 (Attorney docket PHA 23,527) filed 11/10/1998 for 
Yevgeniy Shteyn for UPGRADING OF SYNERGETIC ASPECTS OF HOME NETWORKS. 

15 This patent document relates to a server system with access to an inventory of devices and 
capabilities on a user's home network. The inventory is, for example, a look-up service as 
provided by HAVi or Jini architecture. The server has also access to a data base with 
information of features for a network. The server determines if the synergy of the apparatus 
present on the user's network can be enhanced based on the listing of the inventory and on the 

20 user's profile. If there are features that are relevant to the synergy, based on these criteria, the 
user gets notified. 

All of the above co-pending applications, the HAVI-spec, the Home API-spec 
and Jini-spec, illustrate the direction that CE equipment and home automation is taking. These 
documents also indirectly raise the issue of user-friendliness regarding controllability, 

25 reliability and accessability. How technically sophisticated the equipment may be, it will be of 
little use to the consumer if he/she cannot get it to do what he/she wants it to do and when 
he/she wants it be done. An ergonomically designed universal programmable remote 
controller, such as the "Tronto", may help to lower the acceptance-threshold for home theater 
and home automation systems, owing to the controller's user-friendliness, personalizing 

30 options and wide applicability. 

On the other hand, programming and individualizing such a programmable 
remote is an exercise that requires time, accuracy and attention from the end-user. Verifying or 
testing the user-programmed functionalities is done only after the programming and in 
operational use of the remote. 
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o 

It is an object of the invention to increase user-friendliness and ease-of-handling 
of a programmable remote by facilitating the programming and verification of the 
programmed control steps. 

To this end, the invention provides a method of enabling programming a 
5 programmable remote control device for control of electronic equipment. The method 
comprises enabling running a software application on a computer for emulating manual 
programming of the device upon user input. The method further comprises enabling 
downloading into the device a result from the emulated manual programming. Preferably, the 
user is enabled to control the equipment from the computer upon the emulated programming 

10 in order to verify the programmed steps. This requires that the computer communicate with the 
equipment as if it were the remote. If the remote contains an IR or RF transmitter, the 
computer communicates through a similar IR or RF transmitter, for example. 

Preferably, the application comprises a visual editor for creating and editing a 
configuration of the remote. A configuration defines a user-interface with all its control 

15 functions for apparatus, macro groups, GUI panel lay-outs, button appearances and button 
behaviors. The graphic representation of the configuration provides, for example, a tree 
structure view of the overall configuration. A tree view is a graphical representation of a type 
of data structure, i.e., of a scheme for organizing related pieces of information, in which each 
element is attached to one or more elements directly beneath it. For example, the remote is to 

20 control multiple apparatus in the home. Each specific apparatus has a plurality of controllable 
functionalities or properties. In the tree view, the properties of a specific apparatus are 
arranged underneath the associated device that itself is arranged underneath the home-cluster 
of apparatus. The graphical representation of the configuration provides, for example, also a 
panel view of the control panels as on the remote, including the hard buttons and the soft keys 

25 clustered in panels on the remote's GUI. 

Preferably, the application comprises an emulator for graphically representing a 
model of the remote that allows user-interaction via suitable computer input means, such as a 
mouse, trackball or a keyboard. The emulator is a fully functional emulator of the remote 
control and behaves exactly like the 'real thing'. The emulator can therefore be used by end- 

30 users to quickly test configurations they have made for their 'real' remote control device. 
Without the use of an emulator, the configuration would have to be downloaded to the 'real' 
remote before it could be tested. This is a time-consuming process if the connection between 
the remote and a PC is relatively slow in view of saving costs (e.g., an RS232 link). 
Preferably, the emulator is achieved by defining a software layer which abstracts from the 
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actual hardware on which the remote's window manager (or UIMS) and application (control) 
are running. By implementing this layer on both a 'real' remote and a PC, the window manager 
and application sources can be compiled for both a 'real 1 remote and a PC. The emulator thus 
becomes an almost free byproduct of the 'real 1 remote* s software development. 
5 Emulators are well known in the design and development stage of professional 

software creation and circuitry manufacturing. 


The invention is explained by way of example and with reference to the 

10 accompanying drawings, wherein Fig.l is a block diagram of a system in the invention. 

Fig.l is a block diagram with main components of an information processing 
system 100 in the invention. System 100 comprises a computer 102, here a PC, and a remote 
control device 104, here a "Pronto" of Philips Electronics, mentioned above. Device 104 is a 
user-programmable remote control with an IR-transmitter 106 for IR-control of electronics 

15 equipment (not shown) such as TVs, VCRs, CD players, DVD players, audio pre-amplifiers; 
tuners, etc. Computer 102 is connected to a further IR-transmitter 108. Both computer 102 and 
remote 104 have their own individual hardware platforms 1 10 and 1 12, respectively, that may 
be totally different in implementation. 

The user loads an application 1 14 and a UI management system (UIMS) 116 

20 (or windows manager) onto computer 102, e.g., via a CD-ROM, a diskette or via the Internet. 
UIMS 116 comprises a software library with high-level abstractions for implementing user 
interfaces. UI management systems are known in the art Application 1 14 comprises an 
emulator 120. It is assumed that PC 102 has a visual editor 118. 

Visual editor 1 18 enables the user to create and to edit a configuration of 

25 remote 104. A configuration defines a user-interface with all its control functions for 

apparatus, macro groups, GUI panel lay-outs, button appearances and button behaviors for 
remote 104. The graphic representation of the configuration provides, for example, a tree 
structure view of the overall configuration. A tree view is a graphical representation of a type 
of data structure, i.e., of a scheme for organizing related pieces of information, in which each 

30 element is attached to one or more elements directly beneath it. For example, remote 104 is to 
control multiple apparatus (not shown) in the home. Each specific apparatus has a plurality of 
controllable functionalities or properties. In the tree view, the properties of a specific apparatus 
are arranged underneath the associated device that itself is arranged underneath the home- 
cluster of apparatus. The graphical representation of the configuration provides, for example, 
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also a view of the control panels as they appear on remote 104 when in the programming 
mode. A panel provides a cluster of soft keys whose functions are semantically associated with 
the device or property to be controlled. 

Application 1 14 comprises an emulator 120 for graphically representing a 
5 model of remote 104 based on the configuration created through editor 118. Emulator 120 
allows user-interaction with a model of remote 104 rendered on the display (not shown) of 
computer 102 as if the model were the real remote 104. User-interaction is achieved via 
suitable computer input means, such as a mouse, trackball or a keyboard (not known), as if it 
were real-life remote 104. For example, clicking the mouse when the cursor has been located 

10 over a hard key or soft key on the model of remote represented on the display of computer 102 
triggers an event. The event causes computer 102, through a proper software system 122 for 
collation or otherwise managing of functions and through a driver (not shown), to generate the 
associated IR code transmitted via IR blaster 108. In this manner, the user is enabled to test 
user-programmed configurations directly via computer 102, rather than either having to 

15 program remote 104 itself directly, step for step, or to first download the programmed 
configuration from computer 102 into remote 104, e.g., via serial port 124, and test it 
thereupon. Serial port 124 is preferably a low-cost link (e.g. RS232). Accordingly, 
downloading a configuration created at computer 102 is a rather time-consuming process 
because of this relatively slow link between computer 102 and remote 104. Testing via 

20 computer 102 contributes to the user-friendliness of working with universal programmable 
remote controllers. 

It is noted that computer 102 can be connected to remote 104 to use IR 
transmitter 106 of remote 104, rather than having a separate IR blaster 108. 

The preferred embodiment of the invention adds to the above advantage a cost- 

25 effectiveness aspect. Remote 104, being a universal and user-programmable control device, 
has of course, editing and controlling functionalities 126 and 128, respectively, as specified 
above, bundled in an application 130. Editing and control functionalities 126 and 128 interact 
with platform 112 of remote 104 through a suitable UIMS 132 and collation system 134. 
Emulator 120 is now achieved as follows. A software interface layer 136 has been defined 

30 which abstracts from the actual hardware of remote 104 on which window manager 132 and 
application 130 are running. By implementing this layer 136 on 'real* remote 104 and on 
computer 102 as an interface layer 138, window manager 1 16/132 and application sources 
1 14/130 can be compiled for both the teal' remote 104 and a computer 102. 
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Emulators are well known and used in the professional industry in the 
development phase to allow software development to start before the target hardware has been 
completed. Using the abstraction layers 136 and 138 the emulator, now as a consumer end- 
product, is an almost free byproduct of the 'real' remote's software development. The 
5 invention thus enables the end-user to program or re-program remote 104 more efficiently and 
economically. 

Note that the necessary software components for implementing the editor 118 
and emulator 120 on computer 102 could be downloaded via Internet and as part of a service 
provided by the manufacturer. Within this context, reference is made to co-pending 
10 applications U.S. Serial No.09/160,490 (Attorney docket PHA 23,500) and U.S. Serial 
No.09/189,535 (Attorney docket PHA 23,527) mentioned above. Also note that the 
configuring or re-configuring of programmable remote 104 could be outsourced to a specialist, 
possibly as part of above services, and that the result could be downloaded via Internet onto 
the end-user's computer 102 for testing or fine-tuning. 
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CLAIMS: 
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1 ■ An information processing system (100) having: 

- a computer (102); 

- a user-programmable remote control device (104) having a transmitter (106) for control of 
electronic equipment and; 

5 - a software application (120) for running on the computer to enable an end-user to emulate 
operating the device and control the equipment via the computer 

2. The system of claim 1, wherein 

- the system comprises a further transmitter (108) coupled to the computer; and 

10 - the software application enables the user to control the equipment via the computer and the 
further transmitter. 

3. The system of claim 1, wherein the device is capable of being programmed via 
the computer. 

15 

4. The system of claim 3, wherein the application comprises a visual editor (118). 

5. A method of enabling emulating operating a programmable remote control 
device (104) for control of electronic equipment, the method comprising: 

20 - enabling running a software application (120) on a computer (102) for emulating manual 
operating the device under user control; and 

- enabling the application to control generating control signals for control of the equipment. 

6. The method of claim 5, comprising enabling emulating a programming of the 
25 device through a software application (1 18). 

7. The method of claim 6 comprising enabling downloading from the computer 
into the device a result from the emulated programming. 
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8. A software application for running on a computer (102) and comprising an 

emulator (120) for enabling emulating operating a programmable controller (104) for control 
of electronic equipment; wherein software of the emulator is capable of being run on the 
controller for operational use of the controller. 


9. The application of claim 8, comprising a visual editor (118) for enabling editing 

a control configuration of the controller. 
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